The Coordinated Interplay Account of Utterance Comprehension, Attention, and the Use of Scene Information

نویسندگان

  • Pia Knoeferle
  • Rachel R. Robertson
  • Analia L. Arevalo
  • Stephen M. Wilson
  • Robert A. Liebscher
چکیده

t r a s t , G i l l e t t e e t a l . ( 1 9 9 9 ) s u g g e s t e d t h a t i n f o r m a t i o n f r o m t h e i m m e d i a t e s c e n e w a s l e s s i m p o r t a n t . D e v e l o p m e n t a l fi n d i n g s f u r t h e r d r a w o u r a t t e n t i o n t o p r e r e q u i s i t e s f o r t h e s u c c e s s f u l u s e o f s c e n e i n f o r m a t i o n i n a c q u i s i t i o n : E x p e r i m e n t a l fi n d i n g s s u g g e s t , f o r i n s t a n c e , t h a t t h e i n fl u e n c e o f n o n l i n g u i s t i c i n f o r m a t i o n ( e . g . , o b j e c t s a n d e v e n t s ) o n l a n g u a g e a c q u i s i t i o n i s h i g h l y d e p e n d e n t o n t h e t i m e l o c k b e t w e e n a c h i l d ’ s a t t e n t i o n t o , a n d c h i l d d i r e c t e d s p e e c h a b o u t , t h e s e o b j e c t s a n d e v e n t s ( e . g . , D u n h a m , D u n h a m , & C u r w i n , 1 9 9 3 ; H a r r i s , J o n e s , B r o o k e s , & G r a n t , 1 9 8 6 ; T o m a s e l l o & F a r r a r , 1 9 8 6 ) . I t h a s b e e n s u g g e s t e d t h a t s i m i l a r p r e r e q u i s i t i e s a s f o r c h i l d l a n g u a g e a c q u i s i t i o n a l s o h o l d f o r a d u l t l a n g u a g e c o m p r e h e n s i o n ( e . g . , K n o e f e r l e & C r o c k e r , 2 0 0 6 ) . F i n d i n g s f r o m T o m a s e l l o & F a r r a r ( 1 9 8 6 ) s u p p o r t t h e i m p o r t a n c e o f a t t e n t i o n f o r t h e a c q u i s i t i o n o f c o n c r e t e w o r d s : w h e n a c h i l d ’ s a t t e n t i o n w a s a l r e a d y f o c u s e d o n a n o b j e c t , w o r d s r e f e r r i n g t o i t w e r e l e a r n e d b e t t e r t h a n w o r d s t h a t w e r e p r e s e n t e d w h e n t r y i n g t o r e d i r e c t t h e c h i l d ’ s a t t e n t i o n . B a s e d o n t h e s e fi n d i n g s t h e i m p o r t a n c e o f b o t h l i n g u i s t i c c o n t e x t s / k n o w l e d g e a n d s c e n e c o n t e x t s f o r l a n g u a g e c o m p r e h e n s i o n a n d a c q u i s i t i o n , a s w e l l a s b a s e d o n fi r s t i n s i g h t s i n t o p r e r e q u i s i t e s f o r t h e u s e o f v i s u a l c o n t e x t s i n l a n g u a g e a c q u i s i t i o n r e c e n t p s y c h o l i n g u i s t i c r e s e a r c h h a s m o v e d o n t o e x a m i n e i n m o r e d e t a i l h o w p r e c i s e l y s c e n e i n f o r m a t i o n i n fl u e n c e s a d u l t l a n g u a g e c o m p r e h e n s i o n ( K n o e f e r l e , 2 0 0 7 ; K n o e f e r l e & C r o c k e r , 2 0 0 6 , i n p r e s s ; K n o e f e r l e , H a b e t s , C r o c k e r , &

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Connectionist Model of the Coordinated Interplay of Scene, Utterance, and World Knowledge

The interaction of utterance comprehension and information from a visual scene is characterized by the closely time-locked coordination of incremental comprehension and attention in the scene. Comprehension is also anticipatory, as revealed by attention to objects in a scene before they are mentioned. The interaction is further marked by the rapid and seamless integration of, and adaptation to,...

متن کامل

Learning to Attend: A Connectionist Model of Situated Language Comprehension

Evidence from numerous studies using the visual world paradigm has revealed both that spoken language can rapidly guide attention in a related visual scene and that scene information can immediately influence comprehension processes. These findings motivated the coordinated interplay account (Knoeferle & Crocker, 2006) of situated comprehension, which claims that utterance-mediated attention cr...

متن کامل

The influence of recent scene events on spoken comprehension: evidence from eye movements

Evidence from recent experiments that monitored attention in clipart scenes during spoken comprehension suggests that people preferably rely on non-stereotypical depicted events over stereotypical thematic knowledge for incremental interpretation. The Coordinated Interplay Account (Knoeferle & Crocker, 2006) accounts for this preference through referential processing (e.g., the verb mediates a ...

متن کامل

To appear in Brain and Language Situated sentence processing : The coordinated interplay account and a neurobehavioral model ∗

Empirical evidence demonstrating that sentence meaning is rapidly reconciled with the visual environment has been broadly construed as supporting the seamless interaction of visual and linguistic representations during situated comprehension. Based on recent behavioral and neuroscientific findings, however, we argue for the more deeply rooted coordination of the mechanisms underlying visual and...

متن کامل

The coordinated processing of scene and utterance: evidence from eye-tracking in depicted events

The monitoring of eye-movements in scenes has revealed that a visual referential context can influence the initial structuring and interpretation of an utterance (Tanenhaus, SpiveyKnowlton, Eberhard, & Sedivy, 1995). These and other findings have influenced frameworks of the language system that permit the interaction of visual and linguistic processing (e.g., Bergen & Chang, to appear, Jackend...

متن کامل

Situated sentence processing: the coordinated interplay account and a neurobehavioral model.

Empirical evidence demonstrating that sentence meaning is rapidly reconciled with the visual environment has been broadly construed as supporting the seamless interaction of visual and linguistic representations during situated comprehension. Based on recent behavioral and neuroscientific findings, however, we argue for the more deeply rooted coordination of the mechanisms underlying visual and...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2002